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(57) Abstract 

In a method and a de- 
vice for partial encryption and 
progressive transmission of im- 
agXa fiist section of Ac un- 
afe file is compressed at reduced 

Mality without decryption and 
Hcond section of me .mage 
file is encrypted. Users having 

keywords can decrypt this sec- 
ond section. The first section 
^gcthcrwith the decrypted see- 
S section can men bevrewed 
as a full quality image. The stor 
age space required for stonngdK 
^tst ^section mgeAer-^- 
sentially the same as me stor 
aTspace required for stonng 
^u^crySl full quality mv 
aT e B y using the method and 
otvteLd^bed herein stor- 
age and bandwidth requirements 
for partially encrypted inugesis 
reduced. Furthermore, object 
based composition and process- 
tag of encrypted I objects are fc- 
cilitated. and ROIs can be en- 
crypted. Also, the shape of a ROI < 
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, be encrypted and me original object can 



be decrypted and restored in the compressed domain. 
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A METHOD AND A DEVICE FOR ENCRYPTION OF IMAGES 

. relates to a method - a device for 

encrypting images. 

BACKGROUND OF THE INVENTION AND PRIOR ART 

important when transmittxng and storing secret in 

import au n b available to a user paying for 

information which only shall be avana^ 

the infection. Thus. several methods for ^^^^ 
aata are in frequent use. Such methods can also he 
co digital image data. Examples of encryption methods are DES, 
triple DES and the public-key RSA method. 

„• ,,,1 imaoes can be stored on servers and distributed over a 

rs- — - -ir surevs-r 

- distributed using a j^^j^-^ _ ^ 

service P"-^^ oonCext it might be suitable to 
their business model. In etas ^ 
o£( er Partial access to one set of user ^ ^ ^ 

rr-Llrrto ^t all users from having -11 access 
to all image data. 

^ offered for sale on the Internet. 
News photographs can e.g. be customers to download a 

The service provider wants t« 

evaluation. 

version of the image with reduced quality for e ^ 

„ls. that want to publish « 

are then allowed to download a full quality 

■ provider wants to minimize storage space 
However, such a service provider alternatively 
aa d download bit rates. An unage ^^^^ are given 

«* » diS " ibUte thrice ^Comers can view the images at a 
a „ay or sold for a low price, cu ^ ^ £ull 

reduced quality, but they must pay for ^ 

^ty. xn the case ^^*J™T*°ss^ . 
space on the CD-ROM as efficiently a 
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rt is also essentia! that customers always can access ^ 
using ter friendly, standardised software, image proves are 
Octant to design and support special image viewers and 
customers dcn-t want a proliferation of viewing tools. 

Presently, image providers have to store two versions of the 
i^ges stored. The full guality version is stored as an 

. . ,„„ flle Th is means that the isiage first is 
SIT- I a caressed file format such as ^KO 
Z gt F The compressed file is then encrypted using a suitable 
lotion too7and an encrypted i^ge file is "ore^ ™~ 
must^irst decrypt this file and then access the resulting 
compressed image file using an image viewing tool. Reduced 
X, images are produced by processing the full quality 

in 1 image editing program. They are stored as separate 
compressed image files. 

JLTli ™** transmitted over the network in case of 
versions must also be ^ ^ ^ ^ free 

remote access in the case a resolution 
lew resolution image before paying for the full 

version. 

-wif leant disadvantage if the reduced 
Thi s results m a sxgnxf icant d 

version W contain* a larg ~~ ^ ^ ^ 
information. Images that are 

in particular * ^ . detailed understanding of 

since journal editors wan nig hest quality for 

th e image content and accepts ^ l0 . SQ% o£ the 

printing. The 

storage space of tne iux m 

which is describe includes many new 

verification Model ^^^^ still i-» coding 
functionalities in comparison w ^ creatin9 , 

SUBSTITUTE SHEET (RULE 25) 



PCI7SE99/02106 

VVO 00/31964 

can select a suitable progression mode. Individual objects 
^images be accessed separately in the a» . 
bitstream and progressive transmission can be applied also to 
onsets . m 2000 there is also support for independent* 

decodable coding units. 

SUMMARY . K<3 

It is an object o£ the present invention to overcome the 
problems as outlined above and in particular to reduce the 
a^unt of memory reguired for storing an image. which partially 
"all be possible to view, and also to reduce transmission M 
in a transmission scheme transmitting partially encrypted 



images. 



This object and others are obtained by a technique for partial 
encryption and progressive transmission of images 
eectfon of the image file oan be depressed at reduced quality 
„itnout decryption, i.e. the first low quality image is not 
encrypted, and where a second section of the image file is 
encrypted . 

Th us. users having acoe . to ^Ts^l^ "e 

iB age. The storage space -quired ^or «or-g ^ 

section together is ^^l^JZll quality image. The 
«. m ,ired for storing the unencrypted full quail y 
required for Spending on the 

encryption of the seco ^ q£ ^ se=ond 

emcrvption method, unpxy a ^ 

TectTon compared to the unencrypted second section . 

, he partitioned into multiple sections where 
The image can also be individ ual encryption 

each section may be My fce stored nnencrypted. 

method and Keyword. Some -~ ^ deviee as descrii ed 

M ^"rtharr 0^^ -ges consist of a set of 
herein is that tne comp efl xfc 

ln4 ependently ^L'^ - compressed 

possible to perform encrypt f 

y £„^,r,-i T-,rr entropy decoding • 

domain without performing entropy 
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A reduced quality ^ can be produced according to several 
different main schemes, such as: 
1) Reduced resolution 

M Reduced accuracy of toe transfer* coefficient^ 
3) Exclusion of predefined regions of interest (ROD 

Tnese methods can be co^ined so that -^J^JZ^ 
e.g. produced by reducing both the resolution and the accuracy 
of the transform coefficients. 

By using the method and device for storing and transmitting 
ire data as described herein, several advantages are obtained. 
Thus there is no need to store two different versions of an 

Afferent users are to have access to different Quality 
orThe one andTame image. Also, transmission times become much 
of the one ana t low resolution, 

iower if the information content of J*^ resolutlon 

irmge data can be reused when transmitting the higher 

image data- 

BRIEF DESCRIPTION OF Tlffi DRAWINGS ^ ^ ^ ^ 

The present invention will now u<= .,. h . 
Tth reference to the acco^anying drawings, in which. 

.,„■, view of the file structure of an image. 
" X \^TstZZ^ of images coded according to 

when encrypting an image. server process. 

. Pig . 4 is a diagram illustrating a client serv 
- Fig. 5 is a view of an encryption header 

DETAILED DESCRIPTION ^ ^ original , 

in Fig. 1, a general view of data f±le 

high resolution, — d£ * le ^ 

consists of a number of afferent J shown in Fig . 

sections 101, 103 and^OS. In ^ fx^. ^ rf & high 

lf the action 101 wh^h ^ ^ ^ therefore 
resolution image, is coaeu 
be possible to decode by any receiver. 
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~ ^oi-a which combined with the 
The action 103 which -J -e -«^ oitttioE vetsion o£ 

r;:-:- - — - : ™ tion 

method, and only receivers having access to the correct 
eleven Key will he ahle to decode the data stored in the 
section 103 . 

The section 105. which ccnprises data, which confined with the 
Sta of ection 101 and 103 results in a full resolntron versron 
* the high resolution i^ge. is encrypted using a second 
encryption methoo. and only receivers having access to the 
encryption Key will be ahle to decode the data stored » the 
section 105. 

^s. decoding of the section - * ^"ding of the 

"^srilT^ed^rtnfi^ge data fro. the section 
sectxon 103 resolu tion image 111. Decryption 113 and 
101 ?■ of "he section 105 will, confined with the i»age data 
ZTZ sectTon. 101 end 103 result in a full resolution ^ge 



115. 



^her.ore. indentation in ^^^{^ 

range of progressive n»des can he supported. 

9 o a coding unit is a part of 
in JPEG 2000 verification model 2 0 a c 9 

pncodes a specific bitplane ot « a 
tne bitstream tha enC °*^ ^ can be des cribed as any 
subband. in ^ t of image information. The general 

independently decodable subset a include so 

4=«-r ^necifving the bitstream order is t 
mechanism for specifying . g 

called tags that specifies the next co g ^ . g 

sufficient to specify the -f-^^L * the header that 
Known) . several specific modes car * « l ^ bits that 

defines a default coding unit order thus 

are needed for inserting explicit tags. 
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tt Figs. 2a and 2b block diagram describing how encryption can 
be implemented in the JPEG 2000 encoder and decoder 
respectively, are shown. 

Thus in Fig 2a a block diagram where encryption is performed 
arttr entropy coding in the encoder is shown. Coding unrts enter 
an entropy coding bloc, 201. In the block 201 coding the codrng 
Zils are entropy coded using some suitable entropy code^ The 
output from the block 201 is fed to a selector whrch selects a 
Stable encryption method for each entropy coded codrng unrt. 
sol coding units can be selected to not be encrypted at all. 

in response to the selection made in the selector 203 the 
entropy coded coding units are encrypted in a block 205. The 
2 r^ted coding units together with the not -^^T 
unitTthen form a combined output data stream, whrch can be 
stored or transmitted. 

m Fig 2b a decoder for decoding the bit stream generated by 

v ™L in Fig 2a is shown. Thus, first encrypted and not 

the encoder in rig. c . 1prtor 251, 

coded coding unit, or if the received codrng unrt 
encrypted it is directly transmitted to a block 255. 

In response to the selecticn made in the '^J*^^ . 
entropy coded coding units are decry, te^ _ 

S nitable ^^Z ^^^™ the coding units 
then fed to the block 255. In decryption 
from fed directly from the selector 251 and ^ 

bl ook 253 are entropy ^"^t^sZn which is fed 
output data stream corresponding to the d 
co the entropy coding block 201 rn Frg. 2a. 

■ , h . transmission scheme as shown in the 
E ach coding unrt rn the transmr encrypted block. 

Figs . 2a and 2b is handle* « * separaC ely with any user 

Kach coding unit can also be ^ che sanie iro age 

— ^"irdSerent encryption methods. The 
can be encryptea 
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encryption method used oan further be en encryption algorithm 
c^d "ith a Keyword or a method for generating Keywords . 

n<«erent encryption methods can in such an embodiment have 
SSS aigoTithme bet different ^T^ZZ^ 

in Fig 3 a flow chart illustrating different steps carried out 
Sen encrypting an image are shown. First, in a step 301. an 
tZeTZ partially encrypted is received. The image received 
Tatep 301 is then coded using a coding algorithm generate 
SdepeLntly decodable coding units, e.g. OFEO ,000. xn a step 



303. 



305 some of the coding units of the image coded 
HeXt : "St, are encrypted using some suitable encryption method. 
iD ; P Z The codUg units that are chosen to be encrypted 
such as DES. Tne coamy „ ference s Thus, a user can 

.an be set in accords f^^S « «*" 
cho se to have coding units ^ d ^ ^ 

^-P^«- ^;7 b r c d h ^encrypted are merged into a 
and the coding units wmuu 

single bit stream. 

» Fig. a flow chart ^^J^Z' ^ 
W nen transmitting an « Thus , . clien t 

Ascribed in -^^f * 9 ' The cli ent 4 0l can then issue 
401 is connect * t a serv ^ parCicul ar image, step 

a request towards the serve 



405. 



,„3 renlies by transmitting the coding units of the 
The server 403 replies by ^ ^ ^^ed 

image which are not »orypted >J ^ nQW will ha ve 

coding units oan be decoded by the ^ 
access C o a low reso l»ti» ~£ - ^ _ access C o 

Based on this info^t.on - < J ^ ^ u so the 
the image in a hxgher resoiu 
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client transmits a request to the server requesting such 
information, step 409. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the 
higher resolution version of the image, step 411. If the clxent 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the cost for the image the 
server sends the encrypted coding units together with a key word 
by means of which the encrypted coding units can be decrypted, 
step 415. A secure method for key distribution should be used. 
Examples of such secure methods are described in W. Stalling 
"Data and computer Communications", P 635 -637, Prentice-Hall 
1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and 
encrypted coding units, for example if he has purchased a CD-ROM 
with^mages coded as described herein. The scheme as descrxbed 
in conjunction can be modified so that no image data xs 
Emitted instead the client only agrees to condxtxons set by 
transmxtteo. xnsi-e WO rd(s) which are 

the server in order to have access to the key worcu j 
required to decrypt the encrypted coding unxts of the CD ROM. 

In the case when the method and^evice as described herein^ ^ 

US ed when encoding ™ not standardise 

is advantageous xf the ^ ^ ±s incltlded in the 

^"txSr- T - that is mer r with 

2000 Tags can instead be used to specify how codxng 
units are decrypted. 

In such an esfcodin.ent the JPEG 2000 in*ge header contains an 
in such an ^ , £ ^ coding mt ls 

t I ration Header (EH) should then he appended to 

r£?£ ™— « - — in£omation can 

optionally be merged into JPEG 2000 Tags. 

piQ . „ encry ption header is sho«n. The Encryption Header 

1 ^ ^ — £ ° 110 " in9 S ^ 01S ' 
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D Encryption Mode (EM) . A set of standard encryption modes are 
defined e.g. 

a) .One encryption method is used for all coding units 

b) Bitplanes of less significance than bitplane X are encrypted 

c) Subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

No encryption information need to included in the Tags if an EM 
is defined. 

2) Encryption Mode Parameters (BMP). Parameters (X, Y, ...) that 
are used to define the Encryption Mode are set here. 

3) Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

n^eribtor (EMD) for each encryption 

4) One Encryption Method Descriptor yrw, 

method. The EMD defines any data that is needed by the 

*„t- ri^ervntinq the enclosed encrypted key. Tne 

P t TJ, is usX a fast decryption algorithm » 
decrypted key r used y ^ alloC ates an number to 

taage codrng unrts^ The or^ ^ ^ 

each encryption method. This numu 

5) «. bitstrea* must ---^^1;^^^ one 
encrypted - « ^y - g ^ 

»lt &Crro "° n . S " C t e b noUected in the encryption header or 
symbols could erther be collec as encryption 

alternatively be distributed m the on header „ 

tags. If the HES information rs kept x the encryp ^ 

define a header element - «*» t »^ ™' same or der as the 
a series of UES symbols that are Irsted xn the sam 
coding units appears in the bit stream. 

„ EF is set and the Encryption State is not given in the 
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tppc 2000 Tags can be expanded to contain Unit 
reader, JPEG 2000 Tags ^ encryption 

Encryption State (DBS) symbo tbe next codilig 

method, if any, that is used for encrypting 

unit . 

r -rsrrr rrr,; 

Ts-ctCrpP^Le units belonging t. the « - 

encryption. 

The nain problem is that the shape of the *» might 
Intent. If the shapes are encrypted it is. ^T^^ 
to show a reduced quality image since it a. dxffxcult to 
interpret the coded transform coefficients. 

wi ~» he solved by defining a so called cloaking 
This Problem can be so Xv y ^ ^ ^ several 

shape (c-shape . Thus t e ^ designed to 

^ rrrCe content. A simple e^le of a c- 
shape is a bounding box. 

i« orvr in the JPEG 2000 bit 

X c-shape is "-ed - ^encryption as described in 

stream. The c-shape rs coded veri£icati on Model 

coarilaos christopoulos (edO . ^ therein 

r^r jrr« * shape r s «*- - - « - 



header . 



0 _ shaDe and the transform 
X mas* is created usmg the c shape ^ ^ 

coefficients belonging to the c . P ^ ^ 

U sing the method as described herexn. Th ^ 

all ooefficients £ f^re of the *OXs is thus 

by the c-shape are encrypted. Tne 

protected by encryption. 

encryption '*V~^ ell the corresponding c-shape. 
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s ha*e can be displayed as a blank region. The original ROIs can 
shape can ne y . ^ This is done by decrypting 

be decoded if the keyword xs Known- ^ ROI 

the coefficients belonging to the c-shape. P 
longing to the c-shape is also decrypted. 
„o« be rearranged so that the c-shape is dropped and the 
original^! alt. —res are restored. *ote that this is 
done in the compressed domain. 

The .as* that is used for encoding a ROX is not 

in jpEG 2000. A mask that is sufficiently large so that the ROI 

a « 1M sless will often cover the whole lower subbands. A 
ZsTlt fie n a^weo to expand will lead to a lossy encoding 
Ttbe ROX The masks belonging to different ROXs or to a ROI 
aid the background can be designed to overlap This means that 

efficients are encoded in more than one ROI. Such 
some coetricients cUC . , ROIg 

, -n lM d to a reduced overall compression but the ROIs 
overlap will lead to a reau accessed and decoded 

are more independent so that any ROI can be accessed 

with a good visual result. 

-v.„* for ROIs described herein is not 
dependent of the chore constructed from the 

„ „ ,„d device as described herein storage and 
By using the method and device a s is 

ban dwidth retirements fo, ^^ l ^f tlon „ d processing of 

reduced. Rurthermore. »^ect base P ^ ^ 

encrypted objects "^acrUtat ed, ^ ^ 

re« - restored in the compressed domarn. 

mother advantage is ^^^^£.7 — 
performed at the same time domain (aC the 

the process takes place »^ ^ ^ withouc 

bitstream syntax) it P r£o rmed just before 

encryption. The ^JJ tcransc oder, . Xn this case, 

transmitting the image oy a y 
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^ Kih-rate which will be the case 
i£ rhe encryption increase, ^ . n=rease ta bicrate 

if the encryption is pieced » only added before 

is avoided and the encryption mformatron Y 

transmitting it. 
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CLAIMS 



X. a method of partially encrypting image data comprising the 

feeding the image data usimg an encoding algorithm generating 
independently decodable coding unite, 

least one of the coding units, and 

: ^Z£Z* — ~ — ted " ith codin9 mits 

which are encrypted into a confined bitstream. 

2 & method according to claim 1, characterised in tbat the not 
encrypted coding unite correspond to a low resolution version of 
the image data* 

3 A method according to any of claims 1-2, characterised in 
that different coding units are encrypted using different coding 
methods . 

4 a method according to any of claias 1-3, ^M^J* 
It an encryption flag, which indicates if a coding unit 
encrypted, is inserted in the bit stream. 

- -t iiTnc t — 4 when information 

.. A ^cording t a 

Z that'the shape of the region of interest is 

enclosed in a cloaking shape. 

. ^rtial encryption of image data characterized 
6 . a device for partial enctyy 

^eans for coding the f^^TS^ 

one of the ^* ^LTunita which are not encrypted with 
- means for merging codin « combined bitstream. 

coding units which are encrypted. 

„i™ to claim 6, characterised b, means for 
I^ctC^re^ted coding units - . unit s corresponds 
to a low resolution version of the image data. 
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8 A aevice according « any of claina 6-7, ^""^ *» 
l^Vancx^ t codin, units us^a daffarant 

coding methods. 

- i.j 6 _ o. characterised by 

q a device according to any of claims 6 », 

9. A device accor » which indicates if a 

means for inserting an encryption flag, 

coding unit is encrypted, in the bit stream. 

10 A device according to any of claims 6-9, characterised by 
means for enclosing a region of interest shape in a cloaking 
shape. 
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